An empirical study about online learning with generalized passive-aggressive approaches

نویسندگان

  • Adrian Perez-Suay
  • Francesc J. Ferri
  • Miguel Arevalillo-Herráez
  • Jesús V. Albert
چکیده

This work aims at exploring different approaches to online learning that can be grouped under the common denomination of passiveaggressive techniques. In particular, we comparatively explore the original passive-aggressive formulation along with a recently proposed leastsquares extension and a new proposal in which aggregate updates corresponding to small groups of labelled examples are considered instead of single samples. Preliminary results show that extended algorithms perform at least as good as basic ones in the long term but exhibit a smoother and more robust behavior along learning iterations.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Online Passive Aggressive Active Learning and Its Applications

We investigate online active learning techniques for classification tasks in data stream mining applications. Unlike traditional learning approaches (either batch or online learning) that often require to request the class label of each incoming instance, online active learning queries only a subset of informative incoming instances to update the classification model, which aims to maximize cla...

متن کامل

Online Bayesian Passive-Aggressive Learning

Online Passive-Aggressive (PA) learning is an effective framework for performing max-margin online learning. But the deterministic formulation and estimated single large-margin model could limit its capability in discovering descriptive structures underlying complex data. This paper presents online Bayesian Passive-Aggressive (BayesPA) learning, which subsumes the online PA and extends naturall...

متن کامل

Online multiclass learning with ”bandit” feedback under a Passive-Aggressive approach

Abstract. This paper presents a new approach to online multi-class learning with bandit feedback. This algorithm, named PAB (Passive Aggressive in Bandit) is a variant of Online Passive-Aggressive Algorithm proposed by [2], the latter being an e↵ective framework for performing max-margin online learning. We analyze some of its operating principles, and show it to provide a good and scalable sol...

متن کامل

Confusion-Based Online Learning and a Passive-Aggressive Scheme

This paper provides the first —to the best of our knowledge— analysis of online learning algorithms for multiclass problems when the confusion matrix is taken as a performance measure. The work builds upon recent and elegant results on noncommutative concentration inequalities, i.e. concentration inequalities that apply to matrices, and, more precisely, to matrix martingales. We do establish ge...

متن کامل

A Multilingual Dependency Analysis System Using Online Passive-Aggressive Learning

This paper presents an online algorithm for dependency parsing problems. We propose an adaptation of the passive and aggressive online learning algorithm to the dependency parsing domain. We evaluate the proposed algorithms on the 2007 CONLL Shared Task, and report errors analysis. Experimental results show that the system score is better than the average score among the participating systems.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015